10 - 704 : Information Processing and Learning Fall 2016 Lecture 11 : Oct 5
نویسنده
چکیده
In many machine learning task, we have data Z from some distribution p and the task is to minimize the risk: R(f) = EZ∼p[`(f(Z), Z)] (11.1) where ` is a loss function of interest, e.g. in classification Z = (X,Y ) and we use 0/1 loss `(f(Z), Z) = 1f(X)6=Y , in regression Z = (X,Y ) and we use squared error `(f(Z), Z) = (f(X) − Y ) and in density estimation Z = X and we use negative log likelihood loss `(f(Z), Z) = − log f(X). We are interested in finding the optimal predictor f∗ = arg min f R(f)
منابع مشابه
10 - 704 : Information Processing and Learning Fall 2016 Lecture 6 : Sept 19
1. Integral Estimate: Ĥ(x) = − ∫ p̂(x) log p̂(x)dx 2. Re-substitution Estimate: Ĥ(x) = − 1 n ∑n i=1 log p̂(Xi) where p̂ is obtained using the samples {X1, ..., Xn}. 3. Splitting Data Estimate: Ĥ(x) = − 1 m ∑m i=1 log p̂(Xi) where p̂ is obtained using the samples {Xm+1, ..., Xn}. A cross-validation estimate can be defined similarly, e.g. the leave-one-out estimate is given as Ĥ(x) = − 1 n ∑n i=1 log p̂...
متن کامل10 - 704 : Information Processing and Learning Spring 2015 Lecture 6 : January 29
Last time we discussed the Chow-Liu algorithm, which uses mutual information estimation to learn the best tree graphical model representing data. Recall that, in each iteration, the Chow-Liu algorithm greedily adds an edge between the pair of unconnected variables exhibiting the greatest (estimated) mutual information. Because we only add edges between unconnected variables, (unconditional) mut...
متن کاملComparing the Effect of Three Methods of Lecture, Virtual Education and Flipped Classroom on Learning, information retention and Satisfaction of Students in Isfahan University of Medical Sciences
Introduction:The necessity of using modern educational methods in light of the rapid changes in the needs of communities is felt. The purpose of this study was to compare the effect of three methods of lecture, virtual education and flipped classroom on learning, information retention and satisfaction of students of Isfahan University of Medical Sciences. method:In this quasi-experimental two-...
متن کاملThe Effect of Lecture and E-learning Methods on Learning Mother and Child Health Course in Nursing Students
Introduction: Traditional teaching methods used in medical education are not able to respond to the rapid changes and growth of information as well as continuous change in educational needs of societies. This study was performed to compare the effect of two teaching approaches, lecture and e-learning on learning outcomes of mother and child health course in nursing students of Tehran Medical Un...
متن کامل